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Experiments: 


A  Key  to  Institution  Design 
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Why  experiment? 


Policy  Implemented  to  Boost  Recruiting 


Secondary  Effect:  Private  Sector  Employers 
Increase  Wages,  Reduce  Recruits 


(Tertiary  Effect) 


Tertiary  Effects:  Extra  Spending 
Causes  Tight  Budget,  Manpower  Cuts 


Hypothetical:  Policy  Intended  to  Boost  Recruiting  Causes  Manpower  Costs  to  Rise 
Without  Gains  in  Recruiting  and  Isolated  Spot  Shortages  of  Personnel 
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Practical  Applications  of  Experimental 

Markets 


At  ICES,  we  have  used 
to  model: 

-  Electricity 

-  Health  care 

-  Fisheries 

-  Water  markets 

-  Natural  gas 

-  Labor  Markets 


experimental  markets 
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THE  NPRST  "RAILS"  PROJECT: 

QUANTITATIVE  INVESTIGATIONS  OF 
RECRUITMENT  AND  RETENTION  POLICIES 
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FY'10  Budget:  $133B  for  Personnel 

Costs 


2010  Pentagon  Budget 
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_  Military  Personnel 

■  Operation  &  Maintenance 
-  Procurement 

■  RDT&E 
Military  Housing 

■  Family 
Other 
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Maybe  More 


Line  Item 

Agency 

Amount  {billion 

1  Active  As  soci  orion  Direct  Costs 

Military  pay 

DoD 

$1  17.6 

fieri remenr  benefits 

DoD 

23.7 

fi*rir$3  health  benefit 

DoD 

10.7 

Miscellaneous  benefits 

Doo  ~1 

13.1 

Defense  Heallh  Program 

DoD 

28.0 

2.  Po$-$iv$  Aij&dcHiofl  wirh  Militory 

Military  healih  care 

DoD/VA 

21.0 

VA  tnlillem&nls 

VA 

56.9 

3.  Indirod  Personnel  CoifS- 

Single  housing 

DoD 

1.8 

Family  support 

DoD 

9.2 

Transporlalion 

DoD 

11.8 

Subsistence  of  persons 

DoD 

1.2 

Co  m  mun  icalions/uli  lities 

DoD 

6.2 

TOTAL 

$3  01.1 

Source:  Jim  Arkedis,  Progressive  Policy  Institute  memo  11/2009 
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Key  Design  Requirements 


•  Real  work  environment 

•  Team  and  individual  production 

•  Mimic  dynamics  of  competitive  recruiting 
environment,  including  competition  with  civilian 
sector 

•  Heterogeneous  human  skills 

•  Flexible  decision  architectures 

•  Ability  to  nest  the  environment  within  different 
pension  schemes 
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Staff 

Skill 

Current  Manpower 

Wage  Score  Wo 

Periods  Left 

25 

1 

2 

1 

15 

0 

1 

9 

3 

3 

4 

28 

0 

1 

11 

4 

3 

5 

32 

0 

1 

21 

5 

6 

7 

47 

29 

1 

Postings 

Available  Personnel 

Position 

Minimum  Skill 

Wage 

Bonus 

Duration 

Staff 

Skill 

Score 

2 

2/9 

2/10 

2/9 

24/76 

0/0 

Actual/Target 

4 

2 

2 

1 

0 

1 

m 

n 

EB 

12 

n 

1 

6 

2 

3 

2 

0 

2 

eh 

12 

i? _ i 

1 

8 

3 

3 

3 

0 

10 

3 

4 

4 

0 

12 

4 

S 

4 

0 

16 

5 

5 

5 

29 

18 

6 

5 

6 

0 

22 

5 

6 

7 

29 
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Position  11 

Rank  Staff 

5  5 

Skill  Required 

6 

Score 

Team  Score 

1G 

6 

5 

6 

0 

0 

22 

5 

6 

7 

IS 

0 

Position  12 

Rank  Staff 

4  5 

Skill  Required 

3 

Score 

Team  Score 

12 

4 

5 

4 

0 

0 

16 

5 

5 

5 

15 

0 

18 

6 

5 

6 

0 

0 

22 

5 

6 

7 

15 

0 
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Sailor  Ranking  Screen 


Rank 

Location  Adjustment 

Job  Postings 

Current 

Skill:  6  5  6 

„  skill 

Bonus  Score 

Required 

Skill 

Duration 

Improvement 

A 

-10 

0 

31 

s 

5 

6 

1 

0 

1 

2 

A 

-10 

0 

31 

4 

5 

3 

1 

0 

1 

2 

B 

-20 

0 

0 

1 

1 

1 

1 

0 

1 

2 

C 

0 

0 

0 

1 

1 

1 

1 

1 

0 

2 

B 

-20 

0 

0 

1 

1 

1 

0 

1 

1 

2 

B 

-20 

0 

0 

1 

1 

1 

1 

0 

1 

2 

C 

0 

0 

0 

1 

1 

1 

1 

1 

0 

2 

C 

0 

0 

0 

1 

1 

1 

0 

1 

1 

2 

Periods  to  Pension 

£ 

Navy  Pension 

0 

Periods  to  Retirement 

s 

Navy  Wage 

67 

Civilian  Wage 

(50  +  67)  K  83%  =  102 

Quit  The  Team! 
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Cliff  Vesting  Versus  Continuous  Vesting  Scenarios  in 

NPRST  Rails 
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"Wind  Tunneling"  Algorithms 


Current  software  uses  well-studied  "Greedy 
Algorithm" 

-  Similar  to  professional  sports  draft  model 

-  Each  commander  takes  turns  selecting  best  pick 
until  all  candidates  are  matched. 

Many  other  algorithms  are  possible  and  can 
be  implemented  easily  in  this  environment 
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What  We  Measure  At  Each  Match 


1. 

2. 

3. 

4. 

5. 

6. 

7. 

8. 

9. 

10. 
11. 
12. 

13. 

14. 

15. 

16. 

17. 

18. 

19. 

20. 


id 

treatment  ID 

PeriodID 

JobID 

ShipID 

SubjectID 

SailorRatingForJob 

SailorPreferenceForJob 

SailorRankofJobID 

CommanderRatingforSailor 

SailorOSkilll 

Sailor0Skill2 

SailorOSkilB 

Commander 

RequirementSkilllShip 

Commander 

RequirementSkill2Ship 

Commander 

RequirementSkilBShip 

ShipSkilllRequirement 

ShipSkill2Requirement 

ShipSkill3Requirement 

Commander 


21. 

RequirementSkilllBillet 

Commander 

22. 

RequirementSkill2Billet 

Commander 

23. 

RequirementSkill3Billet 

SkilllDeficit/Surplus 

24. 

Skill2Deficit/Surplus 

25. 

Skill3Deficit/Surplus 

26. 

Skillllmprovement 

27. 

Skill2lmprovement 

28. 

Skill3lmprovement 

29. 

SalaryPostedJobID 

30. 

SalaryPaid 

31. 

BonusPaid 

32. 

adjustment 

33. 

pension 

34. 

CivilianBasePay 

35. 

perfRating 

36. 

balance 

37. 

careerBalance 

38. 

totalWage(ship) 

39. 

postedWage(ship) 

40. 

41. 

42. 

43. 

44. 

45. 

46. 

47. 

48. 

49. 

50. 

51. 

52. 

53. 

54. 

55. 

56. 

57. 
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Manpower(ship) 

actualWage(ship) 

bonusPool(ship) 

bonusPost(ship) 

bonusPaid(ship) 

positions(ship) 

earnings(ship) 

CurrentValueof  Pension 

PerfRatingofSailor 

PerfRatingofShip 

AssignmentExpiresInPeriodX 

CivilianBasePay 

BudgetShip 

BudgetNavy 

BonusShip 

CommanderCompensation 

CommanderBonus 

NavyReadinessScore 


Let's  Experiment! 


•  The  NPRST_Rails  team  completed 
development  of  software,  interfaces, 
databases,  and  communications  for  an  initial 
study  of  two  alternative  types  of  retirement 
compensation  for  Navy  personnel: 
continuous,  versus  "Cliff"  vesting  of  pensions. 

•  We  look  forward  to  continuing  this  initiative! 
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What  other  questions  we  can  explore? 


•  Virtually  any  kind  of  initiative  can  be  modeled  in 
an  experimental  market. 

-  RAILS  offers  the  communications  and  data  processing 
capabilities  to  manage  the  transactions. 

-  RAILS  allows  us  to  look  at  a  wide  variety  of  behavioral 
characteristics,  measure  the  characteristics,  assign 
weights  to  the  most/least  desirable  and  apply  them  to 
assignment  decisions  and  experiment  with  effects. 

-  Experiments  with  RAILS  help  us  to  discover  causal 
effects 
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Thank  You! 
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